This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 
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Abstrac t 

•Fingerprint is used as aeans of person 
• ver.Hcat.on in view of that it has the 
highest reliability and safety. 

Vhole verification process is consisted of 
3 stages, naaely. of the preprocessing stage 
including smoothing, binar Nation, and 
thinning, the feature extraction stage 
including restoration and extraction of 
VtlZVV ?"j- itS f eatu "s. and the aatching 
judgl. 5 ,5nutiae registration and 

Tests for this research with 325 pairs 
or fingerprint resulted in 100 X of 
seperation yhich in turn is turned out to be 
the reliability of this algoritha. 



1- INTRODUCTION 

t k n „.w kil " , »L° f "ethods as" follovs can be 
thoughts the personal identity verification 

1) Hethod by person's thing in hand. 

2) Method >,,,.•» , (I ° CARD - STAMP) 
Hethod by registered aeaory. 

3) U»m»^ k u • . „ ( PASSWORD ) 
hoHv ' ph ? s '? al features of person's 
»ody. ( F, ngep . print Pa i B . print > 

ki.k A f° ne these ■ eth °d' "ethod 3) has the 
highest security because it has high relia- 
bility ( f ew possibility of rejecting tL 
person hiaself) and high slfetyl ev possi- 
bility of accepting other person). And 
because of the characteristics of - Evervh^: 
has the different one." and 5 It's „~E:!?2 

.ethod 3)? UVe " eanS a8 ° nS features u « d 

... Generally autoaatic fingerprint recog- 
n tion systeas are classfied into the identi- 

Idtlt-r" S r- te " and the verification syste- 
Identification syste. is the sa.e as applied 
n the police systea. It is the "lrK" search-" 
.ng syste. that finds fingerprint data Zt\ 

Verfff,'!!- Ut d3ta aBOn * the -"Itiple data 
Verif ication syste. is the "1:1" judging 
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U?U ^ ether th ? L lnput fin «rprint vith the 
or no? ^f- 8338 tfith the "^-registered one 
or not. This is applied to the enterence 
control syste. of i.portant inst?tuUons. 

sysu.m°frfi n8 al80rith « »' identification 

the oral Lill f 0 " 50 ' ,dated 8nd ""bed 

the prat ically useful stage. Several verifi- 

thev°h n SySte - sf2 ; 3 "»J a ™ also developed but 
they have several proble.s in practical 

applications in viev of the cost and the 
precision. 

fk« The purp ? se of this study is to develop 
the verification systea based on PC level. 
IviL^r r i descrIbes fingerprint input 

III trJi C ° St 8nd ° f hi8h S/H rati< > •»<» 
„ ro . otype of recognition algorith. to 
solve above proble.s. 



2 . OUTL INE of PROCESSING 

As shown in <Fig.l>. which is the flow 
or processing, largely 3 stages are involved. 

th. The ,! St , sta ? e is the Pre-processing. As 

oi!l-; SUl 5 °L f thiS Stase depends ° n the 
quality of the input iaage. the input syste. 
is also discussed in this stage. 

Fir,/;, ll* St f 8e * S L the feature "traction. 
First in this stage, the restoration on the 
thinned inage is considered. Hext are extrac- 

Mlau?!2 ,t ? J fMtup " a "d the relations. 

Hi nut lae aeans ridge-ending and bifurcation, 
and ainutiae s features are its coordinates 
and directions as shown in <Fig.2>. Finger- 
print consists of ridges and valleys. 'Ridge- 
to ,L 'tr he p °j nt . each rid8e is ter.inated 
to. and bifurcation' is the point it is 
divided fro.. Considering the local coordi- 

and'L 8 - 516 " v cen * ered on the feature point 
and assigned Y-axis as the direction of its 
Points, the 'relation* is defined as the 
nu.ber of ridges existed between two nearest 
■inutiae on each local quadrantsfl] . 

The 3rd stage-eonsists of tvo kinds of 
Processing. At first, two .etching-required 
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images are transformed to the same coordinate 
system, next the latching score is calculated 
vhich is the similarity between two images. 



3. PRE-PROCESSING 
3-1. IHPUT SYSTEM 

There are generally known of three kind 
of the input nethods as follows : 

1) method to directly input fingerprint 
into a sensor [2] . 

2) method by light vay separation or total 
reflection of the prisn[3J. 

3) method to use the difference of distance 
between ridge and valley by laser(4]. 

On the other hand, high S/H ratio, snail 
size and weight, and low cost should be cons- 
idered in practical application of the input 
system. In this study, considering above 
conditions, the input systea using the total 
reflection aethod of prism is developed. Its 
configuration is shown in <Fig.3>. 

Two LEDs are used as light source. This 
input system used the CCD camera and 
produces the original input image of size of 
512*512 pixels. 8 bits per pixel. 

An original image from this system is 
shown in <Fig.4>. 



3-2. SMOOTH IKG 

Original Input iaage has a many noises 
caused from sensor noise, perspiration aper- 
ature of finger, dust on the prism surface 
and others. In order to eliminate these 
noises, the average filter of 3*3 pixels 
window is applied. 



3-3. BIHAR IZATIOH 

The smoothed iaage has partial shadings 
caused from the light source of the input 
system and the unequal ity of finger pressure. 
The local binarization by the local thresh- 
olding could get rid of this effect. 

The whole image is divided into a lot of 
local areas of 12*12 pixels. In the 1st step, 
the average and deviation value should be 
calculated and then separates the fingerprint 
region from background region based on the 
deviation value. In the 2nd step, it 
separates the ridge from the valley by 
threshold value, which is the average value. 

✓c- Iv e resuIt of binarization is shown in 



3-4. TH INN IKG 

Although features can be extracted 
directly from the binary iaage. this process 
would be low accuracy. From this reason the 
thinning algorithm of Hilditch [5] is done 
in this study. 

The result of thinning is shown in 
<Fig.6>. 



4 . FEATURE EXTRACT ION 
4. 1. Restoration on the Thinned Image. 

Thinned image frequently contains some 
odd structures vhich can't be existed on the 
real fingerprint. 

As shown in <Fig.7>. these structures 
can be grouped into two pseudo minutiae such 
as pseudo ridge-ending and pseudo bifurcation. 
Two of these pseudo minutiae are associated 
within a distance to be classed as follows : 
i) cutted-line 
ii) short-line 
Hi) awn 
iv) bridge 

In this paper, a whole thinned image is 
divided into several local area with the size 
of 61*61 pixels. Starting with the local area 
of the better image quality, restoration is 
processed step-by-step suited for the area's 
structures. The details are followed ; 

1) Joining the cutted line. 

Assume two ridge-endings which has less 
than a distance of 'RT as in <Fig.8>. Under 
the local rectangular coordinate system based 
on the one ridge-ending, if the other ridge- 
ending is included within the range of the 
following equation (4.1). then two ridge- 
endings are joined. 

Yi £ a * Xi (4.1) 

where, a. b : constant. 

Xi, Yi : local coordinate of the 
ridge-ending 'i's. 

2) Elimination of 'Short-Line' and 'Awn'. 

If one ridge-ending is connected to 
another ridge-ending within a distance of 
'R2'. then this line is considered as •short- 
line', and if one ridge-ending to one bifur- 
cation then so as 'awn 1 . 

3) Elimination of Brfdge. 



3. 2. 2 



67 



At first, it is needed to calculate the 
coaptexity for the bifurcation vith the 
equation (4.2) followed. 



A = 2 * FBI - (1/2) * FB2 



(4.2) 



vhere, A : coaplexity. 

FBI : nueber of other bifurcation 

connected to the concerned 

bi f urcat ion. 
FB2 : when FBI is sore than 2. nusb*,- 

of other bifurcations vithi- 

a distance of 'R3\ 

™* Pesult of the restoration is sho% 
in <Fig.9>. 



4.2. FEATURE EXTRACTION. 

" Ridge-ending and Bifurcation, vhich is 
used as feature point in fingerprint recogni- 
tion systea. are detected vith following 
equation (4.3). 



8 

C« s Z I H(i) - H(i*l) I. 
i=l 



(4.3) 



vhere, CH : crossing count nuaber, 

M(i) = 1 : if the pixel included on 
ridge. 
0 : others. 

•I' is the array order of pixels as <Fig.lO>, 
and for the ridge-ending or the bifurcation 
CN values 2 or 6 respectively. 

Feautures of each ainutiae are its coor- 
dinates, the direction and the relation. The 
coordinates are detected on the rectangular 
coordinate systea as illustrated on <Fig.2>. 

The directions are defined as follows ; 

1) Direction of ridge-ending. 

If the concerned ridge-ending has the 
coordinates of (XI. Yl) and the one point 
which has a distance of »R4' on the saae 
ridge line has the coordinates of (X2.Y2). 
then the direction is defined as follows : 

Ql= COS ( Dl / D ) (4.4) 



where. Dl = 
D2 = 

D = IT D1^2 



XI - X2 
Yl - Y2 



D2«2~ 



2) direction of Bifurcation. 

As in <Fig.2>, the direction of the 
bifurcation is the direction of one ridge 
except two ridges which have the saallest 
inner angle. — 



Finally, the relation is extracted. 

5. MATCHING 
5-1. Registration. 

Registration is a procedure to transfora 
the coordinates of the iaages so that the 
laages are overlapped correspondingly. The 
aeasures used in this procedure are as 
follows. 

<1> Features of the ainutiae theaselves : 

i) type ridge-ending or bifurcation 

it) coordinates 
iii) direction 

> Features between two ainutiae : 
i) Relation, 
ii) The angle froa the X-axis to the 
neighbor in the local X-Y plane, 
in) Features of the neighbors : 

a) type. 

b) coordinates. 

c) direction 

These features can be classfied into 
three classes. 

1) Class-1 : aeasures independent of rotation 
and displacement. 
<l>-i. <2>-i, <2>-ii. <2>-iii-a 
aeasures independent of 
displaceaent. 
<l>-iii, <2>-iii- c 
the others 



2) CIass-2 



3) Class-3 



Vith these features, the coordinate of 
the input laage is transforaed as following. 



Step-1 



Step-2 



Step-3 



• Vith the class-l features, find the 
candidates of geoaetric correction 
points of the transfora. 
: Vith the calss-2 features, eliainate 
inappropriate candidates having 
large deviations over a certain 
threshold in cluster of the 
difference of pair directions. 
After further eliaination of 
unprobable pairs with the class-3 
features, the coefficients of the 
Affine transfora are calculated 
by LSE (Least Square Error) aethod 
aaking use of the reaained ainutiae 
pairs. 



The input and file iaage. before and 
after registration, are shown in <Fig.ll> 
respectively. 

5.2 Hatching score calculation 

Making user of-the'pos it ions and 
directions of the reliable ainutiae pairs. 
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the.iatdhfgg scor|^fs."'Jcfl leu lated. 

S = if 2't'si j ?: 7'(7i'* F2 ) ( 5-2 ) 

vhere. . . ■ . •. ■ 
SI : the nuaber of ainutiae pairs 

vithin certain threshold value of 
position and direction. 
Fl : the nunber. of the ainutiae of the 

input iaage. 
F2 : the nunber of the ainutiae of the file 
.iaase*-.-- - * 



C -D.£ sc. us si- on 

ExperiaentV\ith 325 pairs of finger- 
prints^-vo&e poe.f.ornad-to certify the feas- 
bility- of., the algoritha. As shown in 
<Fia^L2> p ^^ewaK.Li.ity of the natch ing 
scores- v lthjth^ sVne/.f.Ln*ers and different 
f in&ers.*as oaJ^ aCLXfefore registration, 
but j^Jncre^&ad. up jto-iOOX after regist- 
ration". ".ThirVfore..Iit iurned out to be 
feasible. 

~vc ire 

The. processus tine takes about 37 
ainutes for the total processing by NEC PC 
9801 The" processing tiae night be shorten 
by : 

1) the use of inage processor. 

2) the use of fingerprint input guide, vhich 
sinplifies the registration procedure. 

3) the enrollment procedure nore. 
sophiscatedly ispiemented. fron vhich 
makes aore enrolled various infornation 
and data to be available to sinpllfy the 
verification procedure. 
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<Fig.3> Conf lgurafion of Input Systen. 
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<Fig.4> Original I.age. <Fig.5> Result of Binarizaticn <Fi g .6> Resu 1 t of Thinning. 
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<Fig.7> Pseudo Hinutiae. 
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<Fig.8> 
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<Figr.9> Result of Restoration. 



<Fig.lO> Array order. 
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<Fig.ll> Registration. 




[ After ] 



<Fig.l2> Distribution of Hatching Score. 
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